Intrinsic and extrinsic noise effects on the phase transition of swarming systems and related 

network models 
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We analyze order-disorder phase transitions driven by noise that occur in two kinds of network models closely 
related to the self-propelled model proposed by Vicsek et. al. to describe the collective motion of groups of 
organisms [Phys. Rev. Lett. 75:1226 (1995)]. Two different types of noise, which we call intrinsic and extrinsic, 
are considered. The intrinsic noise, the one used by Vicsek et. al. in their original work, is related to the decision 
mechanism through which the particles update their positions. In contrast, the extrinsic noise, later introduced 
by Gregoire and Chate [Phys. Rev. Lett. 92:025702 (2004)], affects the signal that the particles receive from 
the environment. The network models presented here can be considered as the mean-field representation of 
the self-propelled model. We show analytically and numerically that, for these two network models, the phase 
transitions driven by the intrinsic noise are continuous, whereas the extrinsic noise produces discontinuous phase 
transitions. This is true even for the small- world topology, which induces strong spatial correlations between 
the network elements. We also analyze the case where both types of noise are present simultaneously. In this 
situation, the phase transition can be continuous or discontinuous depending upon the amplitude of each type of 
noise. 



I. INTRODUCTION 

In spite of many efforts, only a limited understanding has 
been achieved regarding the emergence of collective order in 
non-equilibrium systems. While these systems often present 
features analogous to the those found in equilibrium, such as 
phase-transitions and long-range correlations, it is not clear 
how to use the powerful tools available in equilibrium sta- 
tistical mechanics to analyze their properties. To overcome 
this problem, it may be useful to consider cases where sim- 
ple qualitative characteristics (e.g. the existence and order of 
a phase transition) are common to different non-equilibrium 
systems with similar properties. 

A class of non-equilibrium systems that has sparked in- 
creasing interest in recent years is given by models of groups 
of swarming agents d 12. M 0, HI |a] . These are used to de- 
scribe the collective behavior of self-propelled agents such 
as schools of fish, flocks of birds, or herds of quadrupeds 
10 H, |H] . Even the simplest of these models displays large- 
scale organized structures, in which agents separated by dis- 
tances much larger than their interaction ranges can coordi- 
nate and swarm in the same direction. If noise is added to the 
system, this ordered state is destroyed as the noise level in- 
creases. When the noise reaches a critical value, the system 
undergoes a phase transition to a disordered state where agents 
move in random directions J2, Ht] . This phase transition has 
been quite thoroughly analyzed through numerical simula- 
tions. However, the lack of a systematic theoretical approach 
to non-equilibrium systems has hindered a proper characteri- 
zation of the order-disorder phase transition, and there are still 
doubts about its basic features even in this simplest of cases 

In this paper we are particularly interested in how this phase 
transition might be affected by the way in which the noise is 
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introduced in the system. Two different types of noise, which 
we will call extrinsic and intrinsic, have recently been con- 
sidered in models of swarming |0, O- In these models, at 
every time step each particle receives a signal from its neigh- 
bors that tells the particle in which direction to move next. 
The extrinsic noise consists in that the signal received by the 
particle is blurred (because, say, the environment is not com- 
pletely transparent and the particle cannot see its neighbors 
very well). As a consequence, the particle may move in a dif- 
ferent direction to the one dictated by the neighbors. In con- 
trast, in the intrinsic noise case each particle receives the sig- 
nal sent by the neighbors perfectly, but then it may "decide" to 
do something else and move in a different direction. Thus, the 
extrinsic noise can be thought of as produced by a blurry en- 
vironment, whereas the intrinsic noise comes from the "free 
will" of the particles, so to speak; namely, from the uncer- 
tainty in the particle's decision mechanism. In either case, of 
course, the net result is that, at every time step, the particle 
may move in a direction that departs from the one dictated by 
the neighbors. 

It has been pointed out that these two distinct types of 
noise, extrinsic and intrinsic, can produce very different order- 
disorder phase transitions [12]. This can been shown analyti- 
cally using a network approach in which the elements, instead 
of interacting with the neighbors in a physical space, inter- 
act with any element that is linked to them through a network 
connection. This kind of description has been used to model 
a large range of dynamics, such as the traffic between Internet 
websites or servers, the evolution of an epidemic outbreak, the 
mechanisms triggered by gene expressions in the cell, or the 
activity of the brain Gil Q El EE G3, El- In the context 
of swarming systems, the network approach is equivalent to a 
mean-field theory in which correlations between the particles 
are not taken into account. However, this approach has the 
virtue that it allows us to separate clearly the dynamical inter- 
action rule that determines the dynamical state of the particles, 
from the topology of the underlying network that develops in 
time and space and dictates who interacts with who. There- 
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fore, under the network approach it is possible to focus on 
the effects that the two different types of noise have on the 
dynamics of the system. 

Even when the network approach leaves aside some impor- 
tant aspects of the dynamics of swarming systems (such as 
correlations in space and time), some appealing analogies can 
be established between the swarming and network systems. 
Indeed, in the simplest swarming models, the dynamics is de- 
fined by giving to each agent a steering rule that uses the ve- 
locities of all agents in its vicinity as an input to compute its 
own velocity for the next time-step. This algorithm can be 
associated to a dynamics on a switching network that links at 
every time-step all agents that are within the interaction range 
of each other. In this context, the network is simply a repre- 
sentation of the spatial dynamics of the system. However, it 
has been shown that this analogy can be pushed further suc- 
cessfully and that a static network with long-range connec- 
tions can capture some of the main qualitative behaviors of 
simple swarming models lfl2l fl9i I20I1 . 

In this paper, we compare the properties of the phase transi- 
tions and dynamical mappings of two kinds of network mod- 
els to further explore the analogies described above. We con- 
sider models that incorporate three of the main aspects of the 
interaction between the particles in swarms: an average in- 
put signal from the neighbors, noise, and, in some sense, ex- 
tremely long-range interactions. In the first kind of model the 
elements of the network can acquire only two states, +1 and 
-1; whereas in the second, the elements are represented by 
2D vectors whose angles take any value between and 2n. 
We find that swarming systems and their network counterparts 
indeed present qualitatively similar behaviors depending on 
whether the noise is intrinsic or extrinsic. We also determine 
numerically that the same qualitative features arise when the 
particles are placed on a small-world network, and we extend 
our results to the case in which the network models are subject 
to both types of noise. 

The paper is organized as follows. In Sec. [TT] we present 
the model introduced by Vicsek and his group to describe 
the emergence of order in swarming systems. In particular, 
we focus our attention on how the phase transition seems to 
change when the noise changes from intrinsic to extrinsic. In 
Section |nl] we present a majority voter model on a network, 
which is reminiscent of the Ising model with discrete inter- 
nal degrees of freedom. This model is simple enough as to 
be treated analytically, at least for the case of homogeneous 
random network topologies for which we show analytically 
that the two types of noise indeed produce two different types 
of phase transition. In Sec. [IV] we introduce another network 
model in which the internal degrees of freedom are continu- 
ous (2D vectors). This model can be treated analytically in the 
limit of infinite network connectivity. However, these results 
and extensive numerical simulations clearly indicate that the 
two types of noise again produce two different phase transi- 
tions, which are analogous to the ones observed in the major- 
ity voter model and in the self-propelled model. In Sec.lVlwe 
discuss the mean-field assumptions conveyed in the two net- 
work models and how they relate to the self-propelled model. 
We also show that the nature of the phase transition produced 



by each type of noise does not change when the small-world 
topology is implemented, which produces strong spatial cor- 
relations between the network elements. Finally, in Section[VTl 
we summarize our results. 



II. THE VICSEK MODEL 

Arguably, the simplest model to describe the collective mo- 
tion of a group of organisms was proposed by Vicsek and his 
collaborators yfl. In this model, N particles move within a 
2D box of sides L with periodic boundary conditions. The 
particles are characterized by their positions, X\(t),. . . ,iE/v(0> 



and their velocities vi (f ) = ve' 
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resented here as complex numbers). All the particles move 
with the same speed v. However, the direction of motion 9„{t) 
of each particle changes in time according to a rule that cap- 
tures in a qualitative way the interactions between organisms 
in a flock. The basic idea is that each particle moves in the av- 
erage direction of motion of the particles surrounding it, plus 
some noise. Two interaction rules have been considered in 
the literature, which differ in the way the noise is introduced 
into the system. To state these rules mathematically, we need 
some definitions. Let M n (r) be the circular vicinity of radius r 
centered at x„(t), and K n (t) be the number of particles whose 
positions are within M n {f) at time t. We will denote as U„(t) 
the average velocity of the particles which at time t are within 
the vicinity M„(r), namely 



Un{t) 



1 



K n {t) 



Vj(t). 



(D 



{]:2j{t)eX„(r)} 



For reasons that will be clear later, we will call U„(t) the 
input signal received by the n-th particle v n . With the above 
definitions, the interaction rule originally proposed by Vicsek 
et al. can be written as 



d n (t + At) = Angle U„(t) + r}E, n (t) 



v n (t + At) 
x„(t+At) 



V£ i9„(t+At)^ 

x„(t) + v„(t+At)At, 



(2a) 

(2b) 
(2c) 



where %„(t) is a random variable uniformly distributed in the 
interval [—71, 7t], and the noise amplitude rj is a parameter tak- 
ing a constant value in [0, 1]. The "Angle" function is defined 
in such a way that if u = ue' e , then Angle [u] = 9. Note that in 
this case the direction of the neighbors' average velocity U„(t) 
(the input signal) is computed first and then the noise is added 
to this direction. We will refer to the interaction rule given in 
Eqs. (O as the self-propelled model with intrinsic noise (SP- 
MIN), and to the term T]^ n (t) as the intrinsic noise. 

The second interaction rule, proposed by Gregoire and 
Chate in Ref. IIOII . is given by 



B n (t + At) = Angle U n (t) + rje' 



v n (t+At) 
x„(t+At) 



x n (t)+v n (t + At)At, 



(3a) 

(3b) 
(3c) 
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FIG. 1 : Phase transition in the self-propelled model with (a) intrinsic 
noise and (b) extrinsic noise. In the first case the phase transition 
seems to be continuous, whereas in the second case it is clearly dis- 
continuous. The numerical simulations were performed using sys- 
tems with N = 20000, L~32,r = 0.4 and v = 0.05. 



where ^„(f) and rj have the same meaning as in Eq. (I2ab . In 
this case, a random vector of constant length r\ and random 
orientation £,„(t) is added to the neighbors' average velocity 
U„(t), and then the direction of the resultant vector is com- 
puted. We will refer to the model given in Eqs. (O as the 
self-propelled model with extrinsic noise (SPMEN), and to the 
term ije'^W as the extrinsic noise. 

One might think that the two interaction rules (Eat and (f3al > 
are more or less equivalent and should produce qualitatively 
similar dynamical behaviors. However, as mentioned in the 
introduction, there is a clear physical difference between these 
two ways of adding noise to the system. In the SPMIN the 
uncertainty induced by the noise is in the decision mechanism 
(the Angle function), but not in the input signal that each parti- 
cle receives. In contrast, one could say that in the SPMEN the 
particles are "short-sighted" and do not see well the signal sent 
by the neighbors, which is what causes the uncertainty in this 
case. Thus, one cannot expect, a priori, the onset of collec- 
tive order to be the same in both the SPMIN and the SPMEN, 
for the way in which the noise is introduced in both cases is 
clearly different, not only algorithmically, but also physically. 

To measure the amount of order in the system we define the 
instantaneous value of the order parameter \j/(t ) as 



y/(f) 



1 



N 
n=\ 



(4) 



where (U(t)) = jj Ym=i ^«(0 * s me avera g e velocity of the en- 
tire system at time t . Thus, if y/(t ) ss the particles move in 
random uncorrected directions, whereas if \j/(t) w 1, all the 
particles are aligned and move in the same direction. In the 
limit t — > °°, the order parameter \f/(t ) reaches a constant value 
y = lim,^oo yit) that characterizes the steady state behavior 
of the system 02311 . 

In their original work, Vicsek and his group noted the exis- 
tence of a phase transition from ordered states (y/(f) > 0) to 



disordered states (y/(f) « 0) as the value of the noise intensity 
tj increases. We illustrate this phase transition for the SPMIN 
in Fig. 02 a), which was obtained numerically for a system with 
N = 20000 particles within a box of sides L = 32. The inter- 
action radius and particle speed used in the numerical simula- 
tion are r = 0.4 and v = 0.05, respectively. On the other hand, 
Fig. 01b) shows the phase transition for the SPMEN with ex- 
actly the same parameters as in the previous case. As it can be 
seen from Fig. Q] the phase transition looks continuous (sec- 
ond order) for the SPMIN, whereas it is clearly discontinuous 
(first order) for the SPMEN. 

Numerical simulations performed for larger systems than 
the one used in Fig. Q]also seem to indicate that the phase 
transition exhibited in the SPMIN is continuous J3, S, B- 
Nonetheless, based on numerical simulations, the authors of 
Ref. II 1 Oil have pointed out that the phase transition may be 
discontinuous regardless of the type of noise, and that the ap- 
parent continuity of the phase transition in the SPMIN is due 
to strong finite-size effects. For some reason, these finite size 
effects are not so strong in the SPMEN, in which the phase 
transition is clearly discontinuous. Due to a lack of a general 
mathematical formalism to analyze the self-propelled model, 
(either with intrinsic or extrinsic noise), the way in which each 
type of noise affects the dynamics of the system remains un- 
known. In what follows we present two simplified versions 
of the Vicsek model that can be solved analytically for the 
two types of noise. We show that in these simpler models, 
the phase transition is continuous for the intrinsic noise and 
discontinuous for the extrinsic noise. 



III. THE MAJORITY VOTER MODEL 

The first network model that we consider consists of a set 
of N binary variables, vi , V2, • • • , vn, each acquiring the values 
+1 or -1. The value of each v„ changes in time and is deter- 



mined by a set of k n other elements, .y„ — { v„, , v„ 



*"k„ 



which we will call the inputs of v„. Thus, at every time step 
every element v„ receives a signal from its set of inputs J^„ and 
updates its value according to that signal. Different ways of 
assigning the inputs to each element lead to different network 
topologies. In this section we focus on the homogeneous ran- 
dom topology characterized by the following two properties: 

• All the elements have the same number of inputs K, 
namely, k n ~K for all n. 

• The K inputs of each element are chosen randomly from 
anywhere in the system. 

Note that this is a directed network, for if v n is an input to v m , 
then v m is not necessarily an input to v„. We can think of this 
system as a society of N individuals in which every individual 
v„ can have two opinions (+1 and -1) about an issue. Each in- 
dividual's opinion is influenced by its K friends (inputs), who 
are randomly chosen among the N individuals in the society. 
Generally, each individual will tend to be of the same opinion 
as the majority of its friends, but with a given probability it 
can have the opposite opinion. This probability of having an 
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opinion opposite to that of the majority can be considered as 
a "temperature" that introduces noise in the dynamics of the 
system. Here we consider two ways of introducing this noise, 
which are analogous to the intrinsic and extrinsic noise in the 
self-propelled model. 

We define the input signal U n (t) influencing element v„(t) 



U„(t) 



(5) 



This is just the average opinion of the inputs of v n . With this 
definition, the dynamics of the system with intrinsic noise is 
given by the simultaneous updating of the network elements 
according to the rule 



v»(f+l) 



Sign [U„{t)\ with prob. 1 - 77 
-Sign [U„ (t )] with prob. 77 



(6) 



where Sign[C7„] = -1 if U n < 0, and Sign[f/„] = 1 iff/,, > 0. If 
U„ = then we choose for v n (t + 1 ) either + 1 or - 1 with equal 
probability. The noise amplitude 77 is a constant parameter 
in the interval [0, 1/2] that represents the probability for each 
individual to go against the majoritarian opinion. The above 
interaction rule can also be written in a simpler form as 



v„(* + l) = Sign 



Sign [U n (t) 



Ml 

I-77 



(7) 



where t, n (t) is a random variable uniformly distributed in the 
interval [—1,1]. From the above expression it is clear that this 
way of introducing the noise is equivalent to the intrinsic noise 
of Eq. d2al l. since the noise is added after the Sign function has 
been applied to the input signal U„(t). (Since v„ can only take 
the values +1 or -1, the Sign function has to be applied again.) 

The other way of introducing the noise, which is equivalent 
to the extrinsic noise in Eq. fl3al >, is given by the interaction 
rule 



v n (t + 1)= Sign [U n (t) +47] §,(f)]. 



(8) 



where now the noise is directly added to the input signal U„ (t) 
and then the Sign function is evaluated. <i;„(f) and 77 have the 
same meaning as in Eq. (£7). (The factor 4 in the preceding 
equation is just to guarantee that the phase transition in this 
case occurs within the interval 77 6 [0, 1 /2].) 

For both types of noise, intrinsic and extrinsic, the majority 
voter model exhibits a phase transition from ordered to disor- 
dered states. However, the nature of this phase transition (i.e. 
whether continuous or discontinuous) depends on the type of 
noise. To see that this is indeed the case, we define the order 
parameter \j/(t) for the majority voter model as 



1 N 



(9) 



In the limit f — ► oo, the order parameter y/(t) reaches a station- 
ary value l// that depends on the noise intensity 77. Fig.[2|a) 




FIG. 2: Phase transition in the majority voter model with (a) intrinsic 
noise and (b) extrinsic noise. In the first case the phase transition 
is continuous, whereas in the second case it is discontinuous. The 
symbols represent data obtained from numerical simulations using 
systems with N = 10 5 and K = 3. The solid lines correspond to the 
mean-field prediction. 



shows \y\ as a function of 77 for the intrinsic noise case 
[Eq. (7)], in a system with N = 10 5 and K = 3. It is appar- 
ent that in this case the phase transition is continuous. This 
result is consistent with the behavior of the SPMIN reported 
in Fig. Q2 a )- Contrary to the above, the phase transition for 
the majority voter model with extrinsic noise [Eq. ©] is dis- 
continuous, as is shown in Fig.[2b), which is also consistent 
with the behavior observed in Fig. |TJb) for the SPMEN. Thus, 
changing the way in which the noise is introduced in the voter 
model also changes drastically the nature of the phase transi- 
tion. 

The majority voter model is simple enough to be treated 
analytically. We can even generalize the model to incorporate 
the two types of noise simultaneously. In this generalization, 
the value of each element v„ is updated according to the dy- 
namical rule 



v„(f + 1) = Sign 



Sign [t/„(f) +477^„(f)] 



ML 
1 -172 



, (10) 



where and £„ are independent random variables uniformly 
distributed in the interval [—1,1], and Tji and 772 are con- 
stant parameters taking values in the interval [0, 1 /2]. Thus, if 
Tji = and 772 7^ 0, only the intrinsic noise is present, whereas 
if 771 ^ and 772 = only the extrinsic noise is present. In- 
termediate cases are obtained if both 771 and 772 are different 
from zero. In what follows we consider separately the case in 
which K is finite, and the case in which K is infinite. 



A. Case 1: K < °° 

In Appendix A we present a mean-field calculation show- 
ing that, when the network connectivity K is finite, the order 
parameter y/(t) satisfies the dynamical mapping 



y(t+l)=M( W (t)) : 



(11a) 
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where 



1. Sub-case 1: 772 = 



M( V /) = (1-2t /2 )£j8^(7 ?1 )< 



and the coefficients j3,Jf (t}i) are given by 



(lib) 



k\ (-0 

m 



m— 1 



r • 51 « sin(4^T}iA) 

[cosAJ [sinAJ To aA.(llc) 



In the calculations that leads to the set of equations dTTb one 
assumes that the network elements v„ are statistically inde- 
pendent and equivalent (see Appendix A). These assumptions 
hold as long as the K inputs of each element are chosen ran- 
domly from anywhere in the system, namely, for the homoge- 
neous random topology. For other topologies that introduce 
correlations between the network elements, such as the small- 
world or the scale-free topologies, the mean-field assumptions 
do not necessarily apply. However, when they do apply, the 
order parameter given in Eq. (O becomes the sum of N inde- 
pendent and equally distributed random variables. Therefore, 
the determination of yf(t ) becomes analogous to determining 
the average position of a ID biased random walk, which can 
be solved exactly. 

The stable fixed points of Eq. dl lab give the stationary val- 
ues yf = lim,^oo y/(f ) of the order parameter. It is clear from 
Eqs. ( fTTT i that yf = is always a fixed point. However, its 
stability depends on the values of 771 and 772. Additionally, 
from Eq. dl let it follows that fi£ (rji ) =0 for even values of 
m (because in such a case the integrand in that equation is an 
odd function). Therefore, the polynomial in Eq. ( Ill bb con- 
tains only odd powers of yt{t ) and thus, for each fixed point 
yf, the opposite value — yf is also a fixed point. 

To illustrate the formalism, we present here a detailed anal- 
ysis of the simple case K = 3. However, the results are simi- 
lar for any other finite value of K. For K — 3, the integrals in 
Eq. dl let can be easily computed (we used Mathematica ll2lll ) 
and Eq. (II lbb becomes 

M(y) = (1 -277 2 )(j3 1 3 (77 1 )v/ + j3^(7 7l )v/ 3 ), (12a) 



where 



ft 3 (T?l) 

/3 3 3 (r?i) 



4 + 24i7i -|l-12i7i|-3|l -4171 
32J7i 

8t7 1 ^|1-12t 7i | + |1-4t7 1 | 

327]! 



(12b) 
(12c) 



To determine the stability of the fixed points of the mapping 
M(yf) we have to analyze the value of the derivative M'(yf) = 
dM(\jf)/d\jf. If \M'(yf)\ < 1 at the fixed point, then that fixed 
point is stable. Otherwise, it is unstable. We further divide 
our presentation in three cases. 



Let us first show that the phase transition is discontinuous 
for the case in which 772 = 0, namely, when there is no intrin- 
sic noise and only the extrinsic noise is present. Under these 
circumstances, the fixed-point equation yf = M(yf) becomes 



(13) 



Using Eqs. ( 1 1 2bb and d!2cl i. it is easy to see that yf = 1 and 
yf = — 1 are solutions of the fixed-point equation (fT3l provided 
that < T71 < 5 (in addition to the trivial solution yf = which 
is always a fixed point). From Eqs. d!2bl >. d!2cb and ( TT3l l we 
obtain that 

M'{\) = j3 1 3 (7 7 ) + 3^ 3 3 (T7i) 



if < T71 < 



12 



87)1 



if 



12 < 11 < \ 



14 if ? < 11 

It follows from the above expression that |M'(±1)| < 1 in 
the region < T7 1 < ^, which shows that the fixed points yi = 1 
and yi = — 1 are stable in this region. For rji > j the fixed 
points yf = ± 1 disappear and the only fixed point that remains 
is yf = 0. 

Let us compute now the stability of the fixed point yf = 0. 
From Eqs. (I12bb and (fT3l we get 



M'(0) = /3 3 (r7) 



if 



o<Tj!<n 



12 n+' if ± <m 

1677! 12 - 11 



< 



1 

4t)i 



if j<m 

< 1 for 77 1 > I, whereas 



4' 



from which it follows that |M'(0) 
|M'(0)| > 1 for0< Tji < i. 

The stability analysis presented above reveals that, when 
772 = 0, the stable fixed points discontinuously transit from 
yf = ±1 to yf = as Tji crosses the critical value 77 [ = 1/4 
from below. Therefore, the phase transition in this case is 
discontinuous, as is shown in Fig. |2jb). 



2. Sub-case 2: 771 =0 

We consider now the case in which Tji = 0, that is, when 
only intrinsic noise is present. Taking the limit 77 1 — * in 
Eqs. (HB and ([123) one gets /3 3 (0) =3/2 and J3| (0) = - 1/2. 
Therefore, in this case Eq. (I12ab becomes 



'3 1 - 

m(va) = (i-2tj 2 )( -v--r 



(14) 
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FIG. 3: (Color online) Graph of the dynamical mapping M(l/f) as a 
function of iff for K = 3. (a) Tji =0.1 and different values of 772; 
(b) 772 = 0.1 and different values of r\\. Note that in both cases, as 
the noise intensity decreases the stable nonzero fixed point appears 
continuously. This is always the behavior for finite values of K. 



Let us start by analyzing the stability of the trivial fixed point 
1// = 0. From the above equation we get 



M'(0) = (1-2tj 2 ) 



2 



from which it follows that |M'(0) | < 1 only for 772 > \- There- 
fore, the disordered state characterized by the fixed point 
1// = is stable only for 772 > \- As 772 decreases below the 
critical value T7J ' = 5, the disordered phase becomes unstable 
and two stable non-zero fixed points appear. Assuming yr ^ 0, 
the fixed point equation yr = M(v) can be solved for y/ ob- 
taining 

1/2 



Y = ± 3 



I-2772 



A stability analysis reveals that the above fixed points are 
stable for 772 < 772 (in this region \M(yr)\ < 1) and unstable 
for 772 > 77I (because in this other region \M(y/)\ > 1). Sum- 
marizing, the stable fixed points for the case Tji = are 



±3 







1-27)2 



1/2 



if < T7 2 < T7| 
if 77^ < 772 



where 772 = 1/6. This result is plotted in Fig.[2ja) (solid line), 
from which it is apparent that the phase transition in the major- 
ity voter model with only intrinsic noise is indeed continuous. 
Additionally, for values of 772 below, but close to, the critical 
value 772 at which the phase transition occurs, the order param- 
eter yr behaves as y/~ « ±(772 — 77) 1 / 2 , which shows that this 
phase transition belongs to the mean-field universality class. 




FIG. 4: (Color online) Graph of the dynamical mapping M(yr) as a 
function of yf for K — > °o. (a) 771 =0.1 and different values of 772; 
(b) 772 = 0.1 and different values of 771. Note that in both cases, as 
the noise intensity decreases the stable nonzero fixed point appears 
discontinuously (indicated by the arrows). For infinite K, the phase 
transition is always discontinuous. 



3. Sub-case 3: T\\ 7^ and 772 7^ 

When both types of noise, intrinsic and extrinsic, are 
present in the system, the phase transition is always contin- 
uous for any finite value of K. To illustrate this we present in 
Fig-Sa) the graph of M(y/) for Tji =0.1 and different values 
of 772. Note thatM(y/) is a monotonically increasing convex 
function, and therefore the nonzero stable fixed point appears 
continuously as 772 decreases. The same happens if we now 
fix the value of 772 and vary the value of 77 1, as it is shown 
in Fig.[3jb). This behavior is typical of a second order phase 
transition. 

Assuming y/ ^ and using Eq. d!2ab . the fixed point equa- 
tion y/ = M(y/) can be solved for \j/ obtaining 



v = ± 



1 



1 



PKm) VI -277: 



1/2 



(15) 



For this equation to have real solutions the quantity inside the 
curly brackets must be positive. From Eq. ( |12ct it follows that 
(171) < for any positive value of T]i. Therefore, Eq. (fl3l l 
has real solutions only if 



1 



1-2TJ 2 



<A 3 (T7i)- 



The values of 771 and 772 for which the equality holds in the 
above expression determine the critical line on the 771-772 plane 
at which the phase transition occurs. Fig. [5] shows surface 
plots for the (positive) value of the stable fixed point y/ as a 
function of 77! and 772 for K = 3, K = 9, K = 15 and K — * °°. 
Interestingly, for any finite value of K the phase transition is 
always continuous except for the special case 772 = 0. There- 
fore, for any finite K, even a small amount of intrinsic noise 
suffices to make the phase transition continuous. 
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FIG. 5: Phase transition in the majority voter model. Order parameter iff as a function of the extrinsic noise 77 1 and the intrinsic noise 772 for 
K = 3, K = 9, K = 15 and K — > 00. Note that for any finite value of K the phase transition is always continuous except for the case T]\ = 0. 
Note also that the phase transition it is always discontinuous for K — > °°. 



B. Case 2: K = °° 



IV. THE VECTORIAL NETWORK MODEL 



In Appendix A we show that for K — > °° the temporal evo- 
lution of the order parameter is still given by the dynamical 
mapping Eq. ( 1 1 1 al l, where now M(\y) is 



f -(1-2772) if V<-4r7i 



MO) = < 



if lvl<4i?i (16) 



1-2tj 2 if V / >4T7i 



Fig. HJa) shows the behavior of M(\ff) for — > 00, 771 =0.1 
and different values of 772, and Fig.HJb) shows the same kind 
of plots but now keeping 772 = 0. 1 and varying the value of 771 . 
It can be seen from Fig. |4ja) that the phase transition is dis- 
continuous. Indeed, as 772 decreases below the critical value 
77I = 0.3, the non-zero stable fixed point appears discontin- 
uously (see the point indicated with an arrow in the figure). 
An analogous behavior occurs in Fig. |4|b) when 771 reaches 
the value Tjj = 0.2. Thus, in the limit K — > °° the phase tran- 
sition is always discontinuous (see Fig. [5]). In this sense, the 
discontinuity in the phase transition observed when only ex- 
trinsic noise is used can be considered as a singular limit, ei- 
ther 772 — > or K — > 00, of a phase transition that is otherwise 
continuous. 



The second network model that we analyze, which we will 
call the Vectorial Network Model (VNM), is much closer to 
the self-propelled model than the voter model presented in 
the previous section. As we will see later, the VNM cor- 
responds to a mean-field theory of the self-propelled model. 
It consists of a network with nodes (or elements) which, 
as in the self-propelled model, are the two dimensional vec- 
tors Vi = e' 6 ' , . . . , vn — e' 6N (represented as complex num- 
bers). All the vectors have the same magnitude |v„| = 1 but 
their orientations Gi,...6n in the plane can change. Each 
vector v„ is connected to a fixed set of k n other vectors, 
•&n = {vbjjVj^,...,^ }» from which v n will receive an in- 
put signal. We will call this set the inputs of v„, and consider 
again the homogeneous random topology in which all the ele- 
ments have exactly K inputs chosen randomly from anywhere 
in the system. The input signal U„(t) received by v„ from its 
K inputs is defined as 



Un{t) 



(17) 



7=1 



For the interaction between the network elements we con- 
sider from the beginning a dynamic rule that already incorpo- 
rates both types of noise, intrinsic and extrinsic: 



9„{t + 1) = Angle f7„(f) + 77 1 e 



,&(0 



-TfeC(0, ( 18 ) 
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FIG. 6: Phase transition for the VNM with intrinsic noise only (solid 
line) and the SPMIN with random mixing (symbols), both with N = 
20000. For the SPMIN the size of the box is L = 32 and the radius r 
of the interaction vicinity has been chosen so that the average number 
of interactions per particle coincides with the network connectivity K 
in the VNM. The two panels correspond to (a) K = 5 (r ~ 0.285)and 
(b) K = 20 (r ~ 0.571). Note that the phase transition in this case 
is continuous and the same for both the VNM and the SPMIN with 
random mixing. 

where ^ n {t) and £„(f) are independent random variables uni- 
formly distributed in the interval [— 7T,7r]. The noise intensi- 
ties Tji and T]2, which take constant values between and 1, 
are the amplitudes of the extrinsic (Gregoire-Chate) and in- 
trinsic (Vicsek) types of noise, respectively. Note that, while 
in the self-propelled model the particles can move and thus the 
vectors v„ represent particle velocities, in the VNM the parti- 
cles do not move. Rather, they are fixed to the nodes of the 
network. For this reason, in the VNM the vectors v„ cannot 
be considered as velocities, but just as a given property of the 
particles (such as spin). 

A. Equivalence between the VNM and the self-propelled 
model 

The main difference between the self-propelled model and 
the VNM is that in the former the motion of the particles can 
produce correlations in space and time that couple the global 
order with the local density, affecting the phase transition. 
Such coupling is not present in the VNM unless we choose 
very specific network topologies that change over time. How- 
ever, here we are interested only on the effects that the two dif- 
ferent types of noise have on the phase transition. The VNM is 
especially suited for this analysis precisely because of the ab- 
sence of such complicated dynamical effects as the coupling 
between order and density. 

Nonetheless, it is important to note that the limit of large 
particle speeds of the self-propelled model is well described 
by the VNM. Indeed, if the speed of the particles in the self- 
propelled model is small, then particles that were within the 
same interaction vicinity at time t will most likely remain 
within the same interaction vicinity at the next time step t + At . 



■ (a) 








1 


— 




i 










() 0.2 


0,4 


0.6 






1 



'- (b) 









V. i.i I i.U 0.6 0.8 



FIG. 7: Phase transition for the VNM with extrinsic noise only (solid 
line) and the SPMEN with random mixing (symbols). The systems 
have the same parameters as in Fig. [6] N = 2x10 , L = 32, K = 
4 (r « 0.285) in (a) and K = 20 (r « 0.571) in (b). Note that the 
phase transition in this case is discontinuous and the same for both 
the VNM and the SPMEN with random mixing. 



Therefore, for small particle speeds the spatial correlations be- 
tween the particles are important. Contrary to this, in the op- 
posite limit of large particle speeds, and because of the noise 
in the direction of motion of each particle (whether intrinsic or 
extrinsic), particles that at time t were within the same vicin- 
ity will most likely not remain within that vicinity and end up 
interacting with different particles at the next time step t + At . 
Therefore, in the limit v — > °° of the self-propelled model spa- 
tial correlations are lost in only one time step. This is equiva- 
lent to randomly mixing the particles within the box at every 
time step, which is precisely the condition for the mean-field 
theory conveyed in the VNM to be exactly applicable. 

Fig. |6]shows the value of the order parameter y as a func- 
tion of the noise intensity tj for the VNM with intrinsic noise 
only (solid line), and for the SPMIN with random mixing 
(symbols) ll24ll . Namely, instead of updating the positions of 
the particles in the SPMIN according to the kinematic rule 
given in Eq. d2cb . we just randomly mixed all the particles 
within the box at every time step. We used equivalent systems 
with N = 20000 particles and adjusted the other parameters of 
the SPMIN in such a way that the average number of interac- 
tions per particle K was the same as for the vectorial network 
model [K = 5 in Fig. gja) and K = 20 in Fig. Hb)]). Analo- 
gously, Fig. [7] shows equivalent results but for the VNM with 
extrinsic noise only (solid line) and the SPMEN with random 
mixing (symbols). As we can see from these figures, regard- 
less of the type of noise both the self-propelled model with 
random mixing and the VNM give the same phase transition 
within numerical accuracy. 

Although the above results do not constitute a proof, they 
do suggest that, in the limit of large particle speeds, the self- 
propelled model becomes equivalent to the VNM. It has been 
claimed that this equivalence is obtained only through a singu- 
lar limit 111 ill . Though this might be the case, in our numerical 
simulations with different system sizes we always obtain re- 
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suits analogous to the ones displayed in Figs. [6]and[7j which 
do not seem to show such singular behavior. 



B. Mean-field theory of the VNM 



Let us define the average vector U(t) as 



(19) 



n=\ 



In the context of the self-propelled model, U(t) is the average 
velocity of the entire system. Clearly, the instantaneous value 
of the order parameter \j/(t ) is related to this vector through 



ut) 



Let (y/(t),9(t)) be the polar coordinates of 



t?(f), and Pjj(v, 9;t) its probability distribution function (in 
polar coordinates). Note, then, that y/(t ) is the first radial mo- 
ment of Pjj(\j/, 9;t). 

As in the voter model, we assume that the network ele- 
ments v„ are statistically independent and equivalent. There- 
fore, Eq.dT9b becomes the sum of N independent and equally 
distributed random variables, and the problem of determining 
U(t) is then similar to that of finding the position of a 2D 
biased random walk. In Appendix B we present this mean- 
field calculation, and show that the temporal evolution of the 
Fourier transform of Pq(Y, 9;t) is given by the recurrence re- 
lation 



P (k,r,t+i)=MX)+ E 2n^2 mi)( 



}tny 



o A 



^J (K m X') J di[P (X',i;t)] K e- m *, (20) 



where the 7 m (x)'s are Bessel functions, and A and y are the 
Fourier conjugate variables to y/ and 9 respectively. In prin- 
ciple, this equation can be solved for any finite value of the 
network connectivity K. However, we were able to solve it 
only in the limit case K — » °°. Therefore, we present first the 
analytic results for K — > °°. In the next section we present 
numerical results for finite values of K. 



C. Case 1: K -> °o 

In the limit K — > °° the factor [Pg(X' , /',£)] appearing in 
the second integral of Eq. ( f20b can be replaced by a Dirac delta 
function radially centered at Ky/(t). This leads to 

« n , n,„ sin(m7T772) ,„ n 

P B (x,r,t+\) = 7 (A)+ £ (-0'" y — — MX) 



Ttr\ 2 



1 dx 



x e im ^) I -J ( n x)J m (w(t)x), (21) 

JO X 

From this equation it follows that the order parameter y/(f ), 
which is the first radial moment of Pjj(y/, 9;t), obeys the dy- 
namical mapping (see details in Appendix B) 



, sinfftm) f°° . , . . , . . dx 

nrj2 Jo x 



(22) 



The integral on the right-hand side of the above equation 
is an instance of the Weber-Schafheitlin integrals [22]. After 
the evaluation of this integral, the dynamical mapping for the 
order parameter can be written as 



V/(r + l)=M(v/(?)), 



(23a) 



where the mapping M(\jf) is 



sin(^77 2 )y(r; 



2^1 



M(y) = < 



2' 2 



;2. 



sin(^T]2) 



2F1 



if ^<t?i 



if \if>7]\ 



(23b) 

and 2Fi(a,b;c,d) are hypergeometric functions. The fixed 
points of M(y) gi ve me stationary value \j/ of the order pa- 
rameter. In Ref. lll2ll we have shown that for 772 = 0, the 
non-trivial fixed point of this mapping appears discontinu- 
ously as rji crosses the critical value rji « 0.672 from above. 
On the other hand, for 772 > there is a global factor Sln ^ 2 ^ 
which does not change the discontinuous appearance of the 
non-trivial fixed point. Therefore, for any values of 771 and 
TJ2, the phase transition is discontinuous. 

Fig. [8] shows surface plots of the stationary value y/ as a 
function of rji and 772 for two different cases: (i) when the 
dynamics of the VNM start out from disordered initial condi- 
tions [y/(0) w in Eq. (123aH . and (ii) when the dynamics start 
out from ordered initial conditions [y/(0) « 1 in Eq. ( I23al )l. 
Let us denote as yfdis an d Word me stationary values of the 
order parameter obtained in each of the two cases mentioned 
above, respectively. It is apparent from Fig. [8] that yi or d and 
y/dis are equal in a large region of the 771-772 parameter space. 
However, there is also a region in which yiord an d Wdis mQ dif- 
ferent. This latter region, where the system shows hysteresis, 
is shown in Fig. [9] in which the difference Ay/ = y/ orc ( — yf^ s 
is plotted as a function of 771 and 772. The region for which 
Ayr ^ is a region of metastability where two stable fixed 
points exist, the trivial one y/dis = and the non-zero fixed 
point Word- ^ is clear from these results that the VNM with 
K — > 00 exhibits a discontinuous phase transition for any non- 
zero value of the extrinsic noise 771. On the other hand, for 
77 1 = 0, the amount of order in the system decreases as 772 
increases. However, there is no phase transition in this case 
since yt = only when 772 reaches its maximum value 772 = 1 . 
(In ferromagnetic systems, 772 = 1 would correspond to infi- 
nite temperature.) In other words, for infinite connectivity and 
zero extrinsic noise, the order in the system can never be de- 
stroyed by the intrinsic noise, unless it reaches its maximum 
value. However, in the presence of both types of noise, extrin- 
sic and intrinsic, the phase transition is always discontinuous. 



D. Case 2: K finite 

As it was mentioned before, we do not have an analytic 
solution of Eq. ( f20T > for finite values of K. Nonetheless, nu- 
merical simulations show a phase transition that is continuous 
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FIG. 8: Phase transition in the VNM with K — > oo. The left panel correspond to the phase transition obtained starting out the dynamics from 
a fully disordered condition (y/(0) ~ 0), whereas for the panel on the right the dynamics were started from fully ordered initial conditions 
(l/f(0) ~ 1). In both cases the phase transition is discontinuous for any non-zero value of the extrinsic noise amplitude T}\. These plots were 
obtained by numerically finding the fixed points of M(yr) given in Eq. ((23) 



K =-66 




side to the other (as it does for K — > °°). This implies that the 
phase transition is discontinuous along the boundary of the re- 
gion in which Ay/ ^ 0, but it is continuous along the boundary 
where y/ — > + and Ay/ = 0. 

It is worth emphasizing that for Tji = 0, namely when there 
is no extrinsic noise, the VNM always undergoes a continu- 
ous phase transition from ordered to disordered states as the 
intensity of the intrinsic noise 772 increases. This is consistent 
with the behavior originally reported by Vicsek et. al. for the 
SPMIN [see Fig. [[]»]. On the other hand, for rj 2 = 0, i.e. in 
the absence of intrinsic noise, the phase transition in the VNM 
is discontinuous as a function of the extrinsic noise amplitude 
Tji, which is consistent with the phase transition observed in 
the SPMEN [see Fig. Oft)]. 



FIG. 9: Difference Ayr = yr ort j — yr^ between the two surface plots 
displayed on Fig. [8] The region for which Aiff 7^ is the region of 
metastability where the system exhibits hysteresis. Note that this 
region crosses the entire square [0, 1] x [0, 1] in the J]i-J]2 plane from 
one side to the other. 



in one region of the r\\-r\2 parameter space, and discontinu- 
ous in another region. This is qualitatively different from the 
phase transition observed in the majority voter model, which 
was always continuous for any finite value of K (except for 
J72 = 0). 

Fig. [10] shows fas a function of 771 and 772 for different 
values of K. The results reported in this figure were obtained 
through numerical simulations of the VNM for systems with 
N = 20000. The figures on the left correspond to disordered 
initial conditions ( yr(0) « 0), whereas those on the right corre- 
spond to ordered initial conditions (y/(0) «1), The difference 
Ay/ = yi or d — Ydis as a function of rji and 7J2 is plotted on 
Fig. [TT] It is apparent from these figures that, except for the 
case K = 3, there is a region of hysteresis where Ayr 7^ 0. This 
region grows as K increases, but it does not seem to cross the 
square [0,1] x [0,1] of the Tji-T] 2 parameter space from one 



V. WHAT DO WE MEAN BY "MEAN-FIELD" THEORY? 

In the computations of these two network models we have 
used the "mean field" assumption that all the spins are sta- 
tistically independent and statistically equivalent, though we 
consider arbitrary values of K (the number of particles that 
interact). This leads to phase transitions that can be contin- 
uous or discontinuous depending upon the values of Tji and 
T72. However, a frequent (and frequently equivalent) view of 
what constitutes a "mean field" theory entails the assumption 
that every particle interacts with all the other particles in the 
system. This second assumption is akin to the case K — > 00, 
for which the phase transition is always discontinuous and, in 
general, of a different nature than the one obtained for finite 
K. 

In our network models, the assumption of statistical inde- 
pendence is certainly true for the homogeneous random topol- 
ogy in which the K inputs of each element are randomly cho- 
sen from anywhere in the system. In this case, the probability 
for two distinct elements v m and v„ to have at least one of its K 
inputs in common is of order \/N. In the thermodynamic limit 
N — > 00 this probability is zero. Therefore, for large systems 
all the elements have different sets of inputs and are indeed 
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FIG. 10: Surface plots show the order parameter l//asa function of the extrinsic and extrinsic noise amplitudes r\\ and 772 respectively, for 
K — 3, K — 5, K = 9 and K = 15. The graphs were obtained through numerical simulation for systems with K = 2000 elements. The panels 
on the left correspond to random initial conditions, whereas the panels on the right correspond to fully ordered initial conditions. Note that, 
except for the case K = 3, there is a region of hysteresis where the phase transition is discontinuous. 



statistically independent. independence is no longer valid. However, the qualitative be- 

havior of the phase transition obtained for the VNM on small- 
For other topologies, such as small-world, a large fraction wor ld networks, in which the short-range interactions induce 
of the network elements share inputs even in the thermody- spatial correlations between the network elements, is similar 
namic limit. For this topology the assumption of statistical 
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FIG. 1 1 : Difference At// = i//^ — y/^ between the surface plots displayed on Fig.[l0] The region of metastability where Ai// 7^ grows with 
A". However, for any finite value of K this region does not cross the entire square [0, 1] x [0, 1] in the r\\-r\2 plane. 



to the one observed for the homogeneous random topology de- 
scribed so far. Fig.[l2]shows the phase transition in the VNM 
on small- world networks. To generate this figure we used the 
standard Watts -Strogatz small- world algorithm ffl [l5l [Trill , 
placing the elements on a 2D square lattice. Initially each 
element v n has K = 5 inputs, which are chosen as its four 
first-neighbors and the element v„ itself (i.e., we allow self- 
interactions). Then, with probability p each input connection 
in the network is rewired to a randomly chosen element. Thus, 
if p = we have a regular square lattice, whereas if p = 1 the 
topology becomes homogeneously random. This latter case is 
where our mean-field theory results are exactly applicable. 

Fig. [12 a) corresponds to the case in which there is no in- 
trinsic noise (772 = 0) and only the extrinsic noise is present, 
and Fig. \l2\ b) shows the opposite case where there is no ex- 
trinsic noise (rji =0). The different curves in each figure cor- 
respond to different values of the rewiring probability p. Note 
that the nature of phase transition, i.e. whether continuous or 
discontinuous, does not change with the rewiring probability 
p. What changes is the critical value of the noise at which 
the phase transition occurs, but the continuity of the phase 
transition does not change with p. This is important because 
for small values of p there are strong spatial correlations in 
the system generated by the first-neighbor interactions in the 
small-world network. However, even in the presence of such 
spatial correlations, the phase transition appears to be discon- 
tinuous for the extrinsic noise and continuous for the intrinsic 
noise. One advantage of the VNM is that the finite-size effects 



are much smaller than in the self-propelled model. Therefore, 
the continuous or discontinuous character of the phase transi- 
ion can be very well observed with N = 20000 particles. 



VI. SUMMARY AND DISCUSSION 

Although the self-propelled model proposed by Vicsek et. 
al. is one of the simplest models that we have to describe the 
emergence of collective order in groups of organisms, its an- 
alytic solution has remained elusive for more than a decade. 
Due to this lack of an analytical formalism to analyze the dy- 
namical properties of the self-propelled model, it has not been 
possible to properly characterize some of its most basic fea- 
tures. In this work we have been particularly interested in 
how the way in which the noise is introduced in the system 
affects the nature of the phase transition. In the self-propelled 
model, numerical simulations indicate that the intrinsic noise 
originally proposed by Vicsek and his group seems to produce 
a continuous phase transition. In contrast, the extrinsic noise 
later introduced by Gregoire and Chate generates a phase tran- 
sition that is clearly discontinuous. 

To determine the effect that each type of noise has on the 
phase transition, we have presented two network models that 
capture the main characteristics of the interactions in the self- 
propelled model and that can be handled analytically. These 
two network models, which we call the majority voter model 
and the vectorial network model, can be considered as the 
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mean-field representation of the self-propelled model in 1 and 
2 dimensions. In fact, we have shown numerically that the 
self-propelled model with random mixing, which is obtained 
in the limit of large particle speeds, is fully equivalent to the 
vectorial network model. 

When the number of interactions per particle is finite, our 
numeric and analytic results for the two network models show 
that, in the absence of extrinsic noise, the phase transition 
driven by the intrinsic noise is continuous, in accordance with 
the results obtained for the original Vicsek model (SPMIN). In 
the opposite case, namely when there is no intrinsic noise and 
only the extrinsic noise is present, the phase transition is dis- 
continuous, which is consistent with the behavior reported by 
Gregoire and Chate for the SPMEN. The above results are true 
even for the small-world topology in which there exist strong 
spatial correlations induced by the first-neighbor connections. 

For intermediate cases in which both types of noise are 
present, and for finite network connectivities, the situation is 
more complicated: The voter model exhibits a phase transi- 
tion that is always continuous, whereas for the vectorial model 
there is a region in the noise-parameter space where the phase 
transition is continuous, and another region where it is discon- 
tinuous. In this later case, the region of discontinuity grows as 
the network connectivity increases. Interestingly, in the limit 
of infinite network connectivities and in the presence of both 
types of noise, the phase transition is always discontinuous in 
both the voter model and the vectorial model. 

An interesting open question that follows from our work 
is to what extent can the stationary collective features of the 
network systems agree quantitatively with those of the cor- 
responding swarming models. It has been suggested that the 
coupling between global order and local density could make 
the phase transition in the self-propelled model discontinuous 
regardless of the type of noise fiUl . However, it is not clear 
how such coupling intervenes in the onset of collective order 
in the self-propelled model, nor how it can change the phase 
transition from continuous to discontinuous. To explore this 
idea, and more importantly, to determine whether or not the 
results obtained for the network models presented here can 
be applied to the self-propelled model, further analysis of the 
relation between the dynamics of a swarming system and the 
connectivity of its corresponding network representation is re- 
quired. 
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FIG. 12: (Color online.) Phase transition in the VNM on small-world 
networks, (a) In the absence of intrinsic noise, the extrinsic noise 
produces a discontinuous phase transition regardless of the rewiring 
connectivity p. (b) The phase transition is continuous for all values 
of p when only the intrinsic noise is present. 



APPENDIX A: ANALYTIC RESULTS FOR THE MAJORITY 
VOTER MODEL 

In this appendix we present the analytic computation lead- 
ing to Eqs. (fTTT i and ( fT6b . Let us start by defining the quantities 



X„(t) = 4JT71i$, (f), 

K 

««0) = £ v »,(0i 

.7=1 

S„(t) = U„(t)+Xn(t). 



(Ala) 
(Alb) 
(Ale) 



With these definitions, the dynamical interaction rule Eq. (fTob 
can be rewritten in the equivalent form 



v„(r+l) 



Sign [s n (t)] withprob. 1-T} 2 
-Sign [s„(t)] withprob. r/ 2 



(A2) 



Let <j) n (t) and P^(t) be the probabilities that v„(f) = 1 and 
s n (t) > 0, respectively. From Eq. (IA2t it is clear that <j>„ (f ) and 
P+(f) are related through 



M*) = (i-ib)#(0 + (i-tf(0)n2. 



(A3) 
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The first term on the right-hand side of the above equation 
accounts for the case in which s„ (t ) > and the Sign function 
is evaluated. The second term takes into account the case in 
which s n (t) < and the —Sign function is evaluated. In both 
of these cases v„(t + 1) will be positive. 

Now, we introduce the mean-field assumptions used in this 
computation: 

• The probabilities <j)„(t) and P^{t) are the same for all 
the elements in the network. This assumption states 
that all the network elements are statistically equivalent. 
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Thus, from now on we will drop off the subscript "n" in 
these quantities and use the notation (j) H (t) — <j)(t) and 
P+(t)=P+(t). 

• That the network elements v„ are statistically indepen- 
dent implies that the sum u n (f ) defined in Eq. ( lAlbb can 
be considered as the sum of K independent and identi- 
cally distributed random variables. 



The above equation can be written in terms of y/it) by using 
the relationship given in Eq. (1A4K which gives 



P v (X,t) = cosA -/y/(f)sinA. 



(A9) 



On the other hand, %„ (t ) is a random variable uniformly dis- 
tributed in the interval [— 4Ki~i\,4Kri\], from which it follows 
that 



Note that the order parameter \j/(t) 
pressed in terms the probability <p(t) as 



(v«(f)} can be ex- 



P X (X) = 



1 



4Kr\ x X 



sm4Kr\\X. 



(A10) 



Vr(t) = (v„(0) = (1)0(0 + (-1)(1 -m) =2^(0 - 1, 
from which we obtain 

i + iK0 



Substituting into Eq. (IA8b the results given in Eqs. ( 1A91 > and 
(I A lOt we obtain 



(A4) 



Eq. dA3l ) can then be written in terms of the order parameter 
\j/(t) as 



P s (X,t) = [cos A -;'y/(0sinA] 



K 



K sm{4Kr\\X) 



y/(r + 1 ) = 2 ( 1 - 2 772 )P+ (t ) + 2 772 - 1 . 



(A5) 



The next step in this calculation consists in expressing 
P + (t) as a function of <p(t), or equivalently, as a function 
of yr(t). To this end, let P v (x,t), P u (x,t), P s (x,t), and P x (x) 
be the probability density functions of the random variables 
v„(0, u n {t), s„(t) and X„(f), respectively. (Note that P x (x), 
the probability density function of the noise, is independent 
of time.) From Eq. (I A let it follows that 



= £H) m [cosA]*-'"[v/(0sinA] 

m=0 V"/ 

sin(4ZTT7iA) 
X 4/Tt7iA 

Since P+(r ) is the probability that s n (t) > 0, then 
P+(t) = / P s (x,t)dx. 



(All) 



Therefore, taking the inverse Fourier transform of Eq. ( IA1 II ) 
and integrating the result from to ™ we obtain 



P s (x,t) = [P u *P x ](x,t), 



(A6) 



where "*" denotes a convolution. Analogously, since 
u n (t) is the sum of the K independent random variables 
v ni (0,... 

then P u (x,t) is the /T-fold convolution of P v (x,t) with itself, 
and therefore, P s (x,t) becomes 



(A12) 



' m=0 



(0, all equally distributed with the PDF P v {x,t), wh ere the coefficients ftj ) are given by 



P s (x,t) = \ P v * — *P v *P x ](x,t) 

K times 



' ' ■ ; ' [cosA]^ m [sinA] m 



(A7) 



w / n4Kr]i Jo J- 



(A13) 



It is convenient to transform the above equation to Fourier 
space (in the variable x). Denoting as P v (A,0, Pu(X,t), 
P s (X,t) and P X (X) the Fourier transforms of the correspond- 
ing PDF's, we obtain 



Although it is not obvious from the above expression, it 
happens that j3,f (rji) = 1. To show that this is indeed the case, 
let us define the function G(X) as 



P s (X,t) = [P v (X,t)] K P x (X >t ). 



(A8) 



G(X) — [cos A] 



K sin{4Kr]ik) 
4Kr]\X 



We have now to consider two cases separately, the case for 
which K < oo and the case K —> t». 



1. Case l:K<oo 

By definition of (j)(t), we have that 

P v (x,t) = $(t)8(x - 1) + (1 - 0(O)5(jc + 1), 
where S(x) is the Dirac delta function. Therefore ll25ll . 

P v (X,t) = ^>(t)e- iX + (l-<j>(t))e a . 



Note that G(X) is a symmetric function and that G(0) = 1. 
With this definition, the coefficient /3(f (rji) can be written as 

J8(f (77i) - 2 £ ^ fj(X)e^dXdx 



— 2 G(x)dx, 
Jo 

where G(x) is the inverse Fourier transform of G(X). Since 
G(A) is symmetric, then G(x) is also symmetric and therefore 
[T 00 G(x)dx = 2 G(x)dx, Additionally, since G(0) = 1 then 
J-coG(x)dx = 1, from which it follows that j3 ( f (tJi) = 1. 
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For m > 1 we can exchange the order of integration in 
Eq. ( |A13t by multiplying the integrand by e~ ex . After per- 
forming the integral over x and then taking the limit £ — > we 
obtain 



Af(r?i) 



K\ (-«) 



m— 1 



mj 7i4Krj\ 
[cos lf- m [ S inl} m ^f^ dMAU) 



Using the fact that j3(f(TJi) = 1, Eq. ( IA12b can be written as 

p+ (0 = ^i + £^(ni)[^(0rV 

Finally, substituting the above result into Eq. iA5i we obtain 



^+l) = (l-27] 2 )£^(TJ 1 )[ V A(0r 



(A15) 



2. Case 2: AT -> oo 



By definition [see Eq. ( lAlbH w„(f) is the sum of K inde- 
pendent and identically distributed variables, each with aver- 
age \p(t) and variance 1 - [yO)] 2 - Therefore, for very large 
values of K the Central Limit Theorem allows us to approxi- 
mate P u (x,t) by a Gaussian with average K\j/(t) and variance 
a 2 =K(l-Mt)} 2 ) 



Pu(x,t) 



exp| 



' 2K(l-[ V (t)V 



y/2*K(l - [W(t)} 2 ) 
With this approximation, Eq. ( IA6t becomes 

P s (x,t) ' 



SKrjiy/2nK(l-[Y{t)] 2 ) 

where we have used the fact that P x (x) is a constant nor- 
malized function defined in the interval x G [— 4Kr]i,4Kr]i]. 
From the above expression we can obtain P + (t) by integrat- 
ing P s (x,t) from to °°: 



P + {t) 



1 



8tf77 lv /27r/:(l-[v/(r)] 2 ) 



2JST(1 -MOP) A 



Performing the change of variable jc = Kx', y = /Ty', the above 
expression transforms into 



P + {t) 



1 



4i)j 



7-4TJ 



exp 



(y_y_Vr( t ))2\ 

try dx . 



I(i -MO] 2 ) 



In the limit K — > °° we have 

(y-y-y(r)) 2 



exp 



lim - 



(i-[vWl 2 



f (i-MOP 



5(y-y-vA(0). 



where 5 ( • ) is the Dirac delta function. From the last two equa- 
tions above it follows that, in the limit K — > oo, the probability 
P + (t ) acquires the simpler form 

1 r°° r AT lt 

87]l Jo J-Arn 

After performing the integrals in the above expression we ob- 
tain 



r o 



p+( t ) 



if y/(r) < -4tji 



i (V/(0 + 4t} 2 ) if |vr(f)| <4m 



1 



if \j/(t) > 4tji 



This last result combined with Eq. JA51 > give Eq. ( fT6] l of the 
main text. 



APPENDIX B: ANALYTIC COMPUTATION OF THE PHASE 
TRANSITION FOR THE VECTORIAL NETWORK MODEL 

The dynamics of the Vectorial network model (VNM) are 
given by the interaction rule 



9 m (* + !)= Angle 



•T?2Cm(0 



(Bl) 

where {v m j}"yLi are the K inputs of v m , and % m (t) and £ m (f) 
are independent random variables uniformly distributed in the 
interval [— 71, it] and < Tji , 7}2 < 1. Let us define the extrinsic 
noise vector n e and the intrinsic noise as 

n e = K7] ie '^\ 

m = tj 2 £. 

We will denote as P$ e (r, t, ) the PDF (in polar coordinates) of 
the extrinsic noise n e and as P nj (Q the PDF of the intrinsic 
noise As for the majority voter model, it is convenient to 
define the quantities 



u m {t) = £v my (f), 
s m {t) = u m (t)+n e (t). 



(B2) 
(B3) 



Let (v m ,d m ), (u m ,p m ) and (s m ,Q' m ) be the polar coordinates 
of the vectors v m (t), u m (t), and s m (t), respectively. We will 
denote as Pv m {v m ,6 m ;t), P u - m {u m ,P m ;t), and Pj m (s m , 0' m ;t) the 
PDF's of these three vectors, respectively. In Table IB"1 we sum- 
marize the relevant quantities appearing in this calculation. 
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Scalar 


Amplitude 


PDF 


Fourier Transform 


»i = m£(t) 






Pm 


Vector 


Polar Coor. 


PDF 


Fourier Transform 


n e (t) = Ki\\e^ 








v m (t)=e w ^ 


(v,8) 


p v {v,e-t) 


P v (x, r ,t) 


u m (t) =Ef = i v m; (0 


(«,jB) 


P a (u,P;t) 


p s (x,r>t) 


? m (0 ="»» (0+^(0 


(s,e') 







TABLE I: Notation guide for the different quantities involved in the 
calculation of the phase transition of the VNM. We have omitted 
the subscript m in the PDF's since we assume that all the network 
elements v m are statistically equivalent. 



Note that neither P% (r, ^ ) nor P ni (Q depend on time or on 
the subscript m of v m , whereas the PDF's of v m (t ), u m (t), and 
s m (t) depend on both time and the subscript m. However, in a 
mean-field approximation, we can assume that all the vectors 
v m are statistically equivalent and statistically independent. 
In this case, the functions Pv m ( v m,9m',t), P u " m ( u m, Pm'<t)< an d 
P$ m (s m ,0{ n ;t) are site independent, (i.e., the same for all the 
vectors in the network) and the subscript m can be omitted. 
From now on we will assume that the conditions for the va- 
lidity of the mean-field approximation (statistical equivalence 
and independence) apply. 



1. The order parameter 

To measure the amount of order in the system, we define 
the instantaneous order parameter \]/(t) as 



V(0 



(0 



= l<v(0)l, 



(B4) 



where we have defined (v(f)) 



= 1 v m 



(t). Under the 



mean-field assumption, all the vectors v m are equally dis- 
tributed with the common probability distribution P?(v, 0;t). 
Then (v(f )} can be computed as follows. 

Let /V(A,y,f) be the Fourier transform (in polar coordi- 
nates) of Pp(v, 9;t). The variables A and y are the Fourier 
conjugates of the variables v and 9, respectively. A cumulant 
expansion of Py(X , y; t ) up to the first order gives 



/V(A,yu)«i-«WM + - 



(B5) 



where A is the vector in Fourier space whose polar coordinates 
are (A,y). Denoting as a the angle between (v(t)) and A, and 
using the fact that y/(t ) = | (v(f )) |, Eq. (IB5b can be written as 

P P (A , y, t) « 1 - iy{t)l cos a + ■ ■ ■ . (B6) 

Thus, a first order cumulant expansion of P?(X,y;t) directly 
gives us the order parameter y/(f ). The objective of the cal- 
culation is to find a recurrence relation in time for Pp(A, y;f) 
based on Eq. (IB 1 b . From this recurrence relation we will ob- 
tain the dynamical mapping that determines the temporal evo- 
lution of \jf(t). 



2. Recurrence relation for P?(X, y,t) 

Note first that, since \v m \ = 1 for all m, then P?(v, 9;t) can 
be written as 



p^9;t) = ^-^P e (9;t), 



(B7) 



where Pg{9;t) is the PDF of the angle 9(t) of v(f). From 
Eq. (EU it follows that P e (9;t), 8;t) and />„.(£) are re- 
lated through 



Pe(e;t + l) 



sP 7 (s,9-^,t)ds 



P„,(QdC. (B8) 



Since s(t ) = Lj=i v m . (t)+n e (t), and each of the vectors v mj it) 
is distributed with the PDF P$(v, 9;t), it is clear that 8;t) 
depends on Pg(9;t). Therefore, Eq. ( IB8b is a recurrence rela- 
tion in time for Pg(9;t). This recurrent relation is best solved 
in Fourier space. Denoting as P^(X,y;t) the Fourier transform 
of 9;t ), the above equation can be written as 



Pe(0;t + l) 



1 



dC, \ sds I XdX / dy 

k Jo Jo Jo 



(B9) 



Since Pg(9;t), P^(X,y;t) andP, ;i (Q are periodic functions of 
their angular arguments (9, y and £ respectively), we can ex- 
pand these functions in Fourier series as 



P e (9;t) = £ kn(t)e M , 

P s (x,y~c-J) = £ Xm {x-ty m ^\ 

m=—oa 

Pn,{Q = £ P m e- im ^ 

m=—oa 

where (j> m (t), Xm(k',t) and p m are given by 

<t>m(t) = ^ [ K P e (9-t)e-'" e d9, 
2n J- K 

% m (X;t) = Lj % p^,y;t)e- im Uy, 



(BIO) 
(Bll) 
(B12) 

(B13) 
(B14) 
(B15) 



Substituting Eqs. dBlOl ) and dBlU into Eq. tB9) , can-ying out 
the integration over £ and taking into account Eq. dB15l ) we 
obtain 



III! 6 



= E (0"% / sds / XdXx, n {X-t)J m (sX)e ime , 

mt^oo JO JO 

where we have used the integral representation of the Bessel 
function J m {x) = J 2jt e i( - mz+xcosz > ] dz. It follows from the 
last expression that 

<j> m {t + l) = i"' Pm [ sds [ XdXxm(X;t)J,„(sX). (B16) 
Jo Jo 
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Exchanging the order of integration in the last expression, 
and using the identity 

5(A) _ m 
sJ m (Xs)ds = — - — d„,.o + 
A A z 

where 8 (A ) and 8 m .o are the Dirac and Kronecker delta func- 
tions, respectively, Eq. ( IB16b becomes 

bn(t + 1) = {l) m pm (dm,0Xm(0;t)+mJ^ % m {X\t)^j . 

(B17) 

Note that Eq. (IB 171 > is a consequence of the recurrence rela- 
tion given in Eq. ( |B8t , which in turn follows directly from the 
dynamic interaction rule Eq. (IB 11 1. Now we have to project the 
probability distribution function P$(s, 9;t) onto the unit circle 
by forcing the vector s(t ) to have unit length at time t+l, and 
thus becoming v(t ). To do so, we take the Fourier transform 
of Pp(v, 9,t ) given in Eq. (lB7b . which when evaluated at time 
t+l gives 

/■2k 



3. Dynamical mapping for K — > °° 



Eq. dB241 > is a complicated recurrence relation the exact so- 
lution to which is way out of our hands. However, for large 
values of K, namely, for a large number of interactions per 
particle, we can use the Central Limit Theorem to approxi- 
mate [P$(X, Y,t)] as 

[fyx,r,t)] K *w{-iK{m)'i-*i-c(t)dy 

where (v(f)) and C(f) are the first moment and covariance 
matrix of P$(v, 9 ; t ), respectively, and A is the vector in Fourier 
space with polar coordinates (A, 7). With this approximation, 
Eq. (lB24b becomes 



Pj{X,r,t + l)=2npoJ {X)+ £ mp m J m (X)e t 



P?(X, r ,t + i) = l' n Pe(O;t+i)e- aco < -r)de. (bis) x Tw^a') /* 2?c ^/ e -«{vW>-v-fv-c(r)-X' e -™y 

Jo Jo X' Jo 



Substituting into the above equation the form of Pq (9; t ) given 
in Eq. ( IB 10b (evaluated at t + 1), we obtain 

P?(X, T ,t+l)=2n £ (-i) m <l> m (t + l)J m (X)e im V, (B19) 

m=— 00 

where we have used the integral representation of the Bessel 

function J m (X) = §^ J 2k e^-^^dz. Now we use the 
value of <p m (t + l) given in Eq. (IB 17b . which leads to 



Making the change of variable x = KX' in the above expres- 
sion, we obtain 



P v {X,y;t + 1) =27r/3 7o(A)+ £ mp m J m (X)e 



imj 



3 1 = « 



, . '—j (nx) C n : d/ e -'W')>-i-i*c(0-2 e -6»r' '. 

70 -X Jo 



P ? (A,7;f + l) = 2^o/o(A)+ X! 2%mp m J m (X)e' 



•nX 



Jo Xm{X ~X r ' 



(B20) 



To complete the projection of P$(X,y;t) onto the unit circle 
in a closed form, it only remains to find % m (t) as a function 
of P$(k,Y,t). Since s(f) = Lf=iv mj (0 + n e (t), and we are 
assuming that all the vj are statistically independent, then 

P s (X,yj) = [P?(X, r ,t)] K Pn e (^Y), (B21) 

where ^f e (A,7) is the Fourier transform of the PDF of the 
noise vector n e = Kr\\e'^ . Since B, is uniformly distributed 
in the interval [0,2ti], it follows that P% e (X,j) = Jq(KT]X). 
Therefore, we obtain 

P f {X,Y,t)=[Py{X,Y,t)] K MKnX). (B22) 
Substituting the above expression into Eq. ( IB 14b we obtain 

Xm(X;t) = ^JoiK^X) fj [P,(X,Y,t)] K e-" nr d Y . (B23) 



We can go a step further in the large-/^ approximation and 
neglect the term JgX-C(t)-x appearing in the exponent inside 
the integral of the last expression, which gives 

P?(X,Y,t + \) = 2npoJo{X)+ £ mp m J m (X)e im ? 



' dx 



x 



Jo{r]x) / d7 , e - , '[ ffl ^+^' ) >- T ].(B25) 



Now, we can write (v(f)) -x— \ (v(t))\xcos(Y — a), where 
Y and a are the angles in Fourier space of x and (v(f )), respec- 
tively. The second integral on the right-hand side of Eq. (IB 25b 
becomes 



2k 



-i[mf+(v{t))-x] d y _ I e -i[mY+\(V(t))\xcos(y'-a)] d yl 
Jo 

[■2k 

_ g -ima I e -i[mT+|(v(0)|j:cosT]j T 
JO 



- ma 2K(-i) m j m {\(m\x) 

- ma 2n(-i) m J m (v(t)x), 



Finally, combining this result with Eq. (lB20b . we obtain the 
desired recurrence relation for P$(X , 7; t ): 



iiny 



P?(X,Y,t + 1) =27r/3 7 (A)+ £ mp m J m (X)e 



x j^Jo{KT)X') | o 2 V[A(^/;0]V»<(B24) 



where we have used the fact that y/it) = |(v(f)}|. Substituting 
this result into Eq. ( lB25b . we obtain 

PviX^-t + l) = 2npoJo{X)+ £ 2n{-i) m mp m J m {X) 

in =00 

x e im ^ f -Jo(rix)J m { W {t)x) . (B26) 
Jo x 
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Now, recalling that P ni (Q is a constant normalized func- 
tion in the interval [—717]2, nfy], with < TJ2 < 1, its Fourier 
transform p m is given by 



sin(7Z77l772) 
Pm ~ 1 ■ 

Thus, 2Kpo = 1 and Eq. dB26b can be written as 



(B27) 



P F (A,y;f + l) = / (A)+ £ {-i) m 2Kmp m J m {X) 



Finally, expanding both sides of the above equation up to the 
first order in X, and recalling Eq. (IB6l l for the left-hand side, 
we obtain the recurrence relation for the order parameter 



f°° dx 
y{t + \) = 2npi Jo{r\x)Mw{t)x)—. (B29) 
Jo x 



x e 



im(y—a) 



' dx 
x 



J (rjx)J m (i//(f)jcXB28) This is Eq. $22% of the main text. 
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